Web Survey Bibliography
In contemporary social sciences the survey research processes – from conceptualization and empirical implementation to analysis and dissemination – are increasingly supported with information-communication technologies. However, only parts of this process have fully shifted online so far. In practice, this is true for questionnaire design, distribution and data collection, while earlier stages (questionnaire development and testing) are not fully integrated yet. Similarly, the research literature mostly focuses on questionnaire design and data entry phase with considerable research also on distribution, publication, solicitation and collection. On the other hand, there is almost no literature regarding the role of the web in construction, pretesting and piloting of the instrument. In practice, this step is thus predominantly conducted offline (using word processors), while limited support for online commenting is sometimes included at a rather late stage of questionnaire development.
In this paper, the issues of full web integration of the survey process are discussed. First, a brief overview is presented about past research of the authors in the area of web software. Next, requirements for web survey software are identified according to the needs for effective support in questionnaire construction and testing stage (e.g. inline editing, extensive drag and drop, structuring, commenting, copying, versioning, archiving …).
Finally, results of an experiment are presented, where four groups of users were developing questionnaires in alternative ways:
1. Fully online supported development process (no emailing, no word processors), using a specific web survey software, which was as a pilot developed for this task;
2. Standard approach, where questionnaire is first drafted within some word processor (e.g. MS Word) and then exchanged, discussed and versioned via usual channels (e.g. e-mail, web sites, on-line platforms, forums) or via some external tools (e.g. SharePoint, DropBox, GoogleDoc).
The results show that the questionnaire development process, which is fully online assisted from the very beginning (2), is much faster and it is also much better evaluated by participants than alternative (1). Although such results were of course expected, the vast difference is surprising. Thus, the results definitely identify an area where more research attention is needed, particularly because it is related to the crucial step of the survey process, which is somehow much more important than series of well elaborated methodological issues with relatively minor effects on the survey process.
Workshop Homepage (abstract) / (presentation)
Web survey bibliography - Berzelak, N. (14)
- Data quality of questions sensitive to social-desirability bias in web surveys; 2012; Lozar Manfreda, K., Zajc, N., Berzelak, N., Vehovar, V.
- Costs and Errors in Fixed and Mobile Phone Surveys; 2012; Vehovar, V., Slavec, A., Berzelak, N.
- Web Survey Software; 2012; Berzelak, N., Vehovar, V., Slavec, A.
- Surveying general population: What types of experiments are further needed?; 2012; Vehovar, V., Berzelak, N.
- Web survey software; 2011; Slavec, A., Berzelak, N., Vehovar, V.
- Nonresponse in Web Surveys ; 2011; Lozar Manfreda, K., Berzelak, N., Vehovar, V.
- Cost-Error Optimization Model for Mixed-Mode Surveys; 2009; Vehovar, V., Berzelak, N., Lozar Manfreda, K.
- Relations between functionality and usability of Web survey software tools: An empirical evaluation; 2009; Berzelak, N., Lozar Manfreda, K.
- Empirical Evaluation of Web Survey Software Tools: Powerful or Friendly?; 2009; Vehovar, V., Berzelak, N., Lozar Manfreda, K., Horvat, T., Debevc, M.
- Optimising survey costs in mixed mode environment; 2009; Vehovar, V., Berzelak, N., Lozar Manfreda, K., Belak, E.
- What Can We Achieve With 5 Euros? Optimization of Survey Data Quality Using Mixed-Mode Approaches; 2008; Berzelak, N., Vehovar, V., Lozar Manfreda, K.
- Nonresponse in web surveys within the context of survey errors and survey costs; 2008; Berzelak, N., Lozar Manfreda, K., Vehovar, V.
- Integration of the web into survey data collection: Balancing costs and errors; 2008; Vehovar, V., Berzelak, N., Lozar Manfreda, K.
- Optimization of costs and errors in mixed-mode surveys; 2008; Vehovar, V., Berzelak, N., Lozar Manfreda, K.